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Abstract 

We study two-player zero-sum stopping games in continuous time 
and infinite horizon. We prove that the value in randomized stopping 
times exists as soon as the payoff processes are right-continuous. In 
particular, as opposed to existing literature, we do not assume any 
conditions on the relations between the payoff processes. We also show 
that both players have simple e-optimal randomized stopping times; 
namely, randomized stopping times which are small perturbations of 
non-randomized stopping times. 
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1 Introduction 



Stopping games in discrete time were introduced by Dynkin (1969) as a vari- 
ation of optimal stopping problems. In Dynkin's (1969) setup, two players 
observe the realization of two discrete time processes (xt,r t )te~N- Player 1 
chooses a stopping time fx such that {/x = t} C {r t > 0} for every t G N, and 
player 2 chooses a stopping time v such that {u = t} C {r t < 0} for every 
t G N. Thus, players are not allowed to stop simultaneously Player 2 then 
pays player 1 the amount £ m in{^,i/}lmin{/i,i/}<+oo) where 1 is the indicator 
function. This amount is a random variable. Denote the expected payoff 
player 1 receives by 

j(n,u) = E[x min { Mil ,}l min { Mil ,} <+00 ]. 
Dynkin (1969) proved that the game admits a value; that is, 

sup inf 7(/x, v) = inf sup7(/x, v). 

fj, v v /j, 

Since then many authors generalized this basic result, both in discrete 
time and in continuous time. 

In discrete time, Neveu (1975) allows the players to stop simultane- 
ously, that is, he introduces three uniformly integrable adapted processes 
(at,bt, ct)teN, the two players choose stopping times \i and v respectively, 
and the payoff player 2 pays player 1 is 

Neveu (1975) provides sufficient conditions for the existence of the value. 
One of the conditions he imposes is the following: 

• Condition C: c t = a t < bt for every t > 0. 

It is well known that in general the value need not exist when condi- 
tion C is not satisfied. Rosenberg et al. (2001) allow the players to choose 
randomized stopping times, and they prove, in discrete time again, the ex- 
istence of the value in randomized stopping times. This result was recently 
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generalized by Shmaya and Solan (2002) to the existence of an e-equilibrium 
in the non-zero-sum problem. 

Several authors, including Bismut (1979), Alario-Nazaret et al. (1982) 
and Lepeltier and Maingueneau (1984) studied the problem in continuous 
time. That is, the processes (at,bt,ct)t>o are in continuous time, and the 
stopping times the players choose are [0, +oo] -valued. The literature pro- 
vides sufficient conditions, that include condition C, for the existence of the 
value in pure (i.e. non-randomized) stopping times. 

Touzi and Vieille (2002) study the problem in continuous time, without 
condition C, played on a bounded interval [0, T]; that is, players must stop 
before or at time T. They prove that if (at)t>o and (bt)t>o are semimartin- 
gales continuous at T, and if q < b t for every t € [0,T], then the game 
admits a value in randomized stopping times. 

In the present paper we prove that every stopping game in continuous 
time where (at) t>0 and (bt) t>0 are right-continuous, and (ct) t>0 is progres- 
sively measurable, admits a value in randomized stopping times. In addition, 
we construct e-optimal strategies which are as close as one wishes to pure 
(non-randomized) stopping times; roughly speaking, there is a stopping time 
such that for every S sufficiently small there is an e-optimal strategy that 
stops with probability 1 between times [i and /i + <5. Finally, we construct an 
e-optimal strategy in the spirit of Dynkin (1969) and we extend the model 
by introducing cumulative payoffs and final payoffs. 

Stopping games in continuous time were applied in various contexts. The 
one player stopping problem (the Snell envelope) is used in finance for the 
pricing of the American option, see, e.g., Bensoussan (1984) and Karatzas 
(1988). More recently Cvitanic and Karatzas (1996) used stopping games 
for the study of backward stochastic differential equation with reflecting 
barriers, and Ma and Cvitanic (2001) for the pricing of "the American game 
option". Ghemawat and Nalebuff (1985) used stopping games to study 
strategic exit from a shrinking market. 
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2 Model, literature and main result 



A two-player zero-sum stopping game in continuous time T is given by: 

• A probability space (£l,A,P): (£l,A) is a measurable space and P is 
a a-additive probability measure on (O, A) . 

• A nitration in continuous time T = (J-t)t>o satisfying "the usual con- 
ditions". That is, J- is right-continuous, and J-q contains all P-null 
sets: for every B £ A with P(P>) = and every A C B, one has 
AeF . 

Denote := \It>oFt- Assume without loss of generality that J 7 ^ = 
A. Hence (O, A, P) is a complete probability space. 

• Three uniformly bounded ^"-adapted processes (at, bt, ct)t>o- 

A pure strategy of player 1 (resp. player 2) is a ^"-adapted stopping time 
\i (resp. v). We allow players to never stop, by choosing \i (or v) to be equal 
to +oo. 

The game proceeds as follows. Player 1 chooses a pure strategy jx, and 
player 2 chooses simultaneously and independently a pure strategy v. Player 
2 then pays player 1 the amount a^l^^y + M{ At>i ,} + e At l{ M=1 , <+00 }, which 
is a random variable. The expected payoff that correspond to a pair of pure 
strategies (fi, v) is 

Thus, if the game never stops, the payoff is 0. This could be relaxed by 
adding to the payoff a final payoff x^-n=u=+oo, where x is some A- measurable 
function; see Section^ For a given stopping game T we denote the expected 
payoff by 7r(M) v ) when we want to emphasize the dependency of the ex- 
pected payoff on the game. 

*As we argue below (see Section \'2.1l our results hold for a larger class of payoff pro- 
cesses, that contains the class of uniformly integrable payoff processes. 
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The quantity sup^ inf v v) is the maximal amount that player 1 can 
guarantee to receive; that is, the best he can get (in expectation) if player 
2 knows the strategy chosen by player 1 before he has to choose his own 
strategy. Similarly, by playing properly, player 2 can guarantee to pay no 
more than inf^ sup^ j(fx, v). 

Definition 1 7/sup^ inf^ j(/J>, v) = mi v sup^ 7(yu, v) then the common value 
is the value in pure strategies of the game, and is denoted by v. Any strategy 
\i for which inf !/ 7(/x,z^) is within e of v is an e-optimal strategy of player 1. 
e-optimal strategies of player 2 are defined analogously. 

Many authors provided sufficient conditions for the existence of the value 
in pure strategies and e-optimal pure strategies. The most general set of suf- 
ficient conditions in continuous time was given by Lepeltier and Maingue- 
neau (1984, Corollary 12, Theorems 13 and 15). 

Theorem 2 (Lepeltier and Maingueneau, 1984) // (a) the processes 
(at,bt)t>o are right- continuous, and (b) at = ct < bt for every t > 0, the 
value exists and both players have pure e-optimal strategies. 

Remark 1: Lepeltier and Maingueneau (1984) require that the pro- 
cesses (a t ,bt)t>o a r e optional; that is, measurable with respect to the op- 
tional filtration. Recall that the optional filtration is the one generated by 
all RCLL (right-continuous with left limit) processes. Under the "usual con- 
ditions" it is also the filtration generated by all right-continuous processes 
(see, e.g., Dellacherie and Meyer, 1975, §IV-65). 

Laraki (2000, Theorem 9.1) slightly extended this result by requiring 
that Ct is in the convex hull of at and bt (q € co{at,bt}) for every t > 
instead of (b) of Theorem |2 

The pure e-optimal strategies that exist by Theorem |5] need not be finite. 
Indeed, the value of the game that is given by at = ct = — 1 and bt = 1 for 
every t > is 0, and the only 0-optimal pure strategy of player 1 is (J, = +oo. 
Moreover, if ji is an e-optimal pure strategy of player 1 then P(fi < +oo) < e. 
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It is well known that in general the value in pure strategies need not 
exist. Indeed, take at = h = 1 and c t = for every t > 0. Since fi) = 
it follows that sup M infj, 7(/x, v) = 0. For every stopping time v define a 
stopping time fi u by 

v > 

1 v = 



Since 7(^,1/) = 1 for every f it follows that inf^ sup^ 7(/x, z^) = 1, and the 
value in pure strategies does not exist. 

The difficulty with the last example is that player 2, knowing the strategy 
of player 1, can stop exactly at the same time as his opponent. The solution 
is to allow player 1 to choose his stopping time randomly, thereby making 
the probability that the players stop simultaneously vanish. Indeed, in the 
last example, if player 1 could have randomly chosen his stopping time, say, 
uniformly in the interval [0, 1], then the game terminates before time 1 with 
probability 1, and the probability of simultaneous stopping is 0, whatever 
player 2 plays. In particular, such a strategy guarantees player 1 payoff 1. 

In the game theoretic literature, a standard and natural way to increase 
the set of strategies is by allowing players to randomize. A mixed strategy 
is a probability distribution over pure strategies. In general, this allows to 
convexify the set of strategies, and makes the payoff function bilinear. One 
can then apply a standard min-max theorem (e.g., Sion, 1958) to prove the 
existence of the value in mixed strategies, provided some regularity condi- 
tions hold (e.g., the space of mixed strategies is compact and the payoff 
function continuous). 

Three equivalent ways to randomize the set of pure strategies in our setup 
are discussed in Touzi and Vieille (2002). We adopt the following definition 
of mixed strategies due to Aumann (1964). It extends the probability space 
to ([0, l]x[0,l]xfi,B x B xA, A® A®P), where B is the cr-algebra of Borel 
sets of [0, 1], and A is the Lebesgue measure on [0, 1]. 

Definition 3 A mixed strategy of player 1 is a measurable function (f> : 
[0, 1] xS] -> [0, +00] such that for X-almost every r € [0, 1], fi r (w) := (p(r, lo) 
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is a stopping time. 

The interpretation is the following: player 1 chooses randomly r E [0, 1], 
and then stops the game at time \x T = (p(r, •). Mixed strategies of player 
2 are denoted by ip, and, for every s G [0,1], the s-section is denoted by 
v s :=ip(s, •)• 

The expected payoff that corresponds to a pair of mixed strategies ((f), ip) 

is: 

tO^VO = / l{Vr,v s ) dr ds (1) 
i[0,l] 2 

Though the payoff function given by Q is bilinear, without strong as- 
sumptions on the data of the game the payoff function is not continuous for 
the same topology which makes the strategy space compact. 

Definition 4 If sup^, inf ^ "f(4>, ip) = mf?/> su P</> 7(^3 VO then the common value 
is the value in mixed strategies, and it is denoted by V . Every strategy cp 
such that inf<7,7(0, ip) is within eofVis e-optimal for player 1. e-optimal 
strategies of player 2 are defined analogously. 

Observe that sup^ inf^ 7(0, ip) = sup^, infj, 7(0, u), where v ranges over 
all pure stopping times, and that inf^, sup^ 7(0, ip) = inf^ sup M ^(fi, ip), where 
/i ranges over all pure stopping times. Hence, to prove the existence of the 
value, it suffices to show that sup^, inf v 7(0, v) = inf^, sup^ 7(/i, ip). More- 
over, one always has sup^, inf^ j((p, ip) < inf^ sup^, ^((p, ip). 

Existence of the value in mixed strategies in stopping games with contin- 
uous time was studied by Touzi and Vieille (2002), who proved the following. 

Let <3?t be the space of all mixed strategies (p such that A<8>P(/U r < T) = 1, 
and let ^>t be the space of all mixed strategies ip such that \®P(v s < T) = 1. 

Theorem 5 (Touzi and Vieille, 2002) For every T > 0, if (a) the pro- 
cesses (at,bt)t>o are semimartingales with trajectories continuous at time 
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T, (b) ct < b t for every t > 0, and (c) the payoff processes are uniformly 
integrable, then: 

sup inf 7(0,1/)) = inf sup 7(0, ?/>). 

Touzi and Vieille (2002) prove that under conditions (a) and (b) of The- 
orem [S] it is sufficient to restrict the players to certain subclasses of mixed 
strategies. They then apply Sion's (1958) min-max theorem to the restricted 
game. 

Remark 2: By Dellacherie and Meyer (1980, §VII-23), under the "usual 
conditions", a semimartingle is always RCLL (right-continuous with left 
limit). 

One class of mixed strategies will play a special role along the paper. 

Definition 6 Let 5 > 0. A mixed strategy (ft is 5-almost pure if there exists 
a stopping time \i and a set A € Tn such that for every r £ [0, 1], (j)(r, •) = /i 
on A, and (p(r, •) = \x + rb on A c . 

Recall that a process (xt) t>0 is progressively measurable if for every 
t > the function (s, uS) \— > x s (uj) from [0, t] x Q is measurable with respect 
to S([0,t]) x Ft, where £?([0,t]) is the cr-algebra of Borel subsets of [0,t]. 
Recall also that an optional process is progressively measurable (see, e.g., 
Dellacherie and Meyer, 1975, §IV-64). 

The main result we present is the following. 

Theorem 7 If the processes (at)t>o an d {°t)t>o ar ^ right- continuous and if 
( c t)t>o is progressively measurable then the value in mixed strategies exists. 
Moreover, for every e > there is 5q £ (0, 1) such that for every 5 € (0, <5o) 
both players have 5-almost pure e-optimal strategies. 

Our proof heavily relies on the result of Lepeltier and Maingueneau 
(1984), where they extend the discrete time variational approach of Neveu 
(1975) to continuous time. 
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2.1 On the payoff processes 

A /"-adapted process x = (xt) t>0 is in the class V (see, e.g., Dellacherie and 
Meyer, 1980, §VI-20) if the set {x -l{ (T<+00 }, a is a ^"-adapted stopping time} 
is uniformly integrable (see, e.g., Dellacherie and Meyer, 1975, §11-17). That 
is, if for every bounded stopping time a, Ep[\x a \lr Xa > r \] converges uniformly 
to as r goes to +oo. 

This implies that the set {Ep[|x -|l{ (T<+00 }], a is a ^"-adapted stopping time} 
is uniformly bounded (see, e.g., Dellacherie and Meyer, 1975, §11-19). Ob- 
serve that every uniformly bounded process, as well as every uniformly in- 
tegrable process, is in the class V (see, e.g., Dellacherie and Meyer, 1975, 
§11-18)). 

For a measurable process (xt) t>0 and r > 0, define the process (x\) t>Q 

by: 

x r t (u) := x t {uj)l{\ Xt ^)\< r } + rlj^)^} - rl^^-r}- 

By Dellacherie and Meyer (1975, §11-17), x € T> if and only if for every 
e > there exists r > such that for every stopping time a one has 
E [\x a — x r a \ l{ - <+00 }] < e. The process (x r t ) t>0 is uniformly bounded by r, 
and, in addition, if (xt) t>0 is right-continuous or ^"-adapted, so is (x£ )^>q ■ 
If the payoff processes (at) t>o, (h)t>o and (ct)t>o are not necessarily 
bounded but are in the class V, then for every e > there exists r > such 
that 

E P [(\a a - o£| + \b a - b r a \ + \Cff - c r a \) l{ a<+OQ }] < e. 

Hence, if the game V = (O, A, P; J 7 , (at,bt,ct)t>o) satisfies the assumptions 
of Theorem it admits a value. Moreover, every e-optimal strategy in 
T r := (U, A, P; J 7 , (a\, 6[, c[)t>o) is 2e-optimal in V. 

In particular, all the existence results that are proved for uniformly 
bounded payoff processes (Lepeltier and Maingueneau (1984)) or uniformly 
integrable payoff processes (Touzi and Vieille (2002)) are valid for payoff 
processes in the class T> as well. 
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3 Proof 



In the present section the main result of the paper is proven. From now 
on we fix a stopping game T such that (at,bt)t>o are right-continuous and 
(°t)t>o 1S progressively measurable. 

3.1 Preliminaries 

The following Lemma will be used in the sequel. 

Lemma 8 For every J 7 -adapted stopping time r and every e > there is 
5 > such thatp({\a t — a T \ < e Vt € [r, r + 5}}) > 1 - e. 

A similar statement holds when one replaces the process (at)t>o by the 
process (&t)t>Q. 

Proof. Since (at)t>o is right-continuous, it is progressively measurable 
(see, e.g., Dellacherie and Meyer, 1975, §IV-15). 

Let 6 T ( u \(u) = infjs > t{uj) : \a s (u) — a T (u)\ > e}. The progressive 
measurability of (a t )t>o implies that 5 t ^{uj) is measurable with respect to 
Too (see, e.g., Dellacherie and Meyer, 1975, §111-44). 

The right-continuity of (at)t>o implies that P{{uj : 5 t ^(uj) > 0}) = 1. 
Since P is a-additive and {ui : 5 T ^(u>) > 0} = U n> o{u> : 5 T f u \(u}) > -}, the 
lemma follows by choosing 5 > sufficiently small so that P({uj : <J T (w)( w ) > 
5}) > 1 -e. ■ 

By Lemma |H1 and since the payoff processes are uniformly bounded, one 
obtains the following. 

Corollary 9 Let a stopping time t and e > be given. There exists 5 > 
sufficiently small such that for every ^-measurable set A C {r < +oo}, 
and every stopping time (i that satisfies r < \i < r + 5, 

IEp^IaI-EpMaH < 2e. 
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3.2 The case a t < b t for every t > 

Definition 10 Let S > 0. A mixed strategy <p is S-pme if there exists a 
stopping time [i such that 

cP(r, •) = n + r5 Vr€[0,l]. (2) 

Observe that a <5-pure mixed strategy is in particular 5-almost pure. 
When \x is a stopping time, we sometime denote the 5-pure mixed strategy 
defined in (j2j) simply by \i + rS. 

In this section we prove the following result: when at < bt for every t > 
the value in mixed strategies exists, it is independent of (ct)t>o, and both 
players have <5-pure e-optimal strategies, provided 5 is sufficiently small. 

The idea is the following. Assume player 1 decides to stop at time t. If 
Ct < (H, player 1 wants to mask the exact time in which he stops, so that 
player 2 cannot stop at the same time. Since payoffs are right-continuous, 
he can stop randomly in a small interval after time t. If cj > at, player 2 
prefers that player 1 stops alone at time t rather than to stop simultaneously 
with player 1 at time t. 

Proposition 11 If at < bt for every t > then the value in mixed strategies 
exists. Moreover, the value is independent of the process (ct)t>o, and for 
every e > there is do > such that for every 5 E (0, So) both players have 
S-pure e-optimal strategies. If at < ct < bt for every t > then the value in 
pure strategies exists, and there are e-optimal strategies that are independent 
of (c t )t>o- 

Proof. Consider an auxiliary stopping game T* = (Q, A, P; J 7 , (a^ , 6^ , c%)t>o), 
where a J 1 = at and b% = c% = bt for every t > 0. 

By Theorem |21 the game V* has a value in pure strategies v*. We will 
prove that v* is the value in mixed strategies of the original game. Since T* 
does not depend on the process (ct)t>o, the second claim in the proposition 
will follow. 
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Fix e > 0. Let \x be an e-optimal strategy of player 1 in T*. In particular, 
infy 7r*(/i, v) > v* - e. 

We now construct a mixed strategy <f> that satisfies infj, 7r(0, v) > v* —he. 
By LemmalHltliere is 5 > such that p({\at—afj_\ < e Mt £ [n,fi+5]}) > 1—e. 
Define a <5-pure mixed strategy 4> by 

(f)(r, ■) = n + r5 Vr G [0,1]. 

Let v be any stopping time. Since [i is e-optimal in T* , by the definition 
of r*, and since A (g> P(/U + r£ = v) = 0, 

- e < 7r* (/x, ^) 

= e pK1{/j<i/} + ^l{/i>i/}] (3) 
= EA®p[a /J l{ /J+r< 5 <1/ } + a M l{ At< ^ <At+r ^} + b v l{^> v }]. 

Since A ® P(/i + rS = v) = and (ct) t>0 is progressively measurable, 

7r(<^, ^ ) = E A(gl p [a^+rsl^+rS^} + ^l{ At +r5>z/} + c ^ 1 { A t+r5=i/<+oo}] 

= E A( g,p [a M +r5l{/Lt+r5<v} + ^l{M+r5>^}] ( 4 ) 
= E A(g) p [a / i+ r <5l{^+r<5<!/} + K^-{^ <v<l _i+r5} + ^{^u}] ■ 

By Corollary and since at < &t for every i > 0, 

E A(8ip[a/il{^<i/< A t+r5}] < EA 8 ,p[a i/ l{ At< ^ <At+r< 5}]+2e < E A( g,p[6 l ,l{ At< j y<At+r .5}]+2e. 

(5) 

Corollary |H1 implies in addition that 

EA®p[<Vl{ (U + n 5<i'}] < EA0p[a M+r 5l{ At +r5<^}] + 2e. (6) 

By ©-©, 

-e < 7t*(m,^) < 7r0,^) + 4e. 

Since ^ is arbitrary, infj, 7r(</>, f ) > v* — 5e. 

Consider an auxiliary stopping game T** = (fi, .4, P; JF, (of, b**, c**) t >o), 
where a™ = tf* = a t and tf* = b t for every t > 0. 
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A symmetric argument to the one provided above proves that the game 
r** has a value v** , and that player 2 has a mixed strategy ip which satisfies 
sup M 7rO,V0 < v** + he. 

Since c|* = at < bt = c£ for every t > 0, i>** < u*. Since sup M 7r(A i ) V') — 
7r(</>,V0 > inf„7r(<^), 

t;* > t;** > sup7r(A*,V') — 5e > inf tt(</>, ^) — 5e > v* — lOe. 

Since e is arbitrary, t>* = i;**, so that v* is the value in mixed strategies of 
r, and (j) and tp are 5e-optimal mixed strategies of the two players. 

If at < ct < h for every t > then 7r** (n, v) < 7r(/^, v) < 7r* f ) for 
every pair of pure strategies (fi, ^ ). Hence 

u** = supinf 7r** (/i, ^) < supinf 7r(//, ^) 

< inf sup7r(^, v) < inf sup 7r* (fJ., v) = v* = v** . 

" ft v p 

Thus sup^ infjy 7r(/u, z/) = inf^ sup M 7r(/^, v) : the value in pure strategies 
exists. Moreover, any e-optimal strategy of player 1 (resp. player 2) in T* 
(resp. r**) is also e-optimal in T. In particular, if at < Q < bt for every 
t > 0, both players have e-optimal strategies that are independent of (ct)t>o- 
■ 

3.3 Proof of Theorem [3 

Define a stopping time r by 

r = m£{t >0,a t > b t }, 

where the infimum of an empty set is +oo. Since (at — bt)t>o is progressively 
measurable with respect to (J r t) t>0 , r is an ^"-adapted stopping time (see, 
e.g., Dellacherie and Meyer, 1975, §IV-50). 

The idea is the following. We show that it is optimal for both players to 
stop at or around time r (provided the game does not stop before time r). 
Hence the problem reduces to the game between times and r. Since for 
t £ [0, r[, at < bt, Proposition fTTI can be applied. 
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The following notation will be useful in the sequel. For a pair of pure 
strategies (fi, v), and a set A £ A, we define 



jr(p, v, A) = Ep[l A (a^l {At<Jy} + b^l {fl>u} + c M l {(U=iy<+oo} )]. 

This is the expected payoff restricted to A. For a pair of mixed strategies 
(4>, ip) we define 



jr((/>,ip;A) = / yr(fJ-r,v s ;A)dr ds, 
J\o,i] 2 



'[0,1]= 

where /U r and ia, are the sections of <f> and ^ respectively. 
Set 

A) = {t = +00}, 

A\ = {t < +00} n {c T > a T > 6 T }, 

^2 = {t < +00} PI {a T > c T > b T }, and 

A 3 = {r < +00} n {a T >b T > c T }. 

Observe that (^40)^41)^2 5^43) is an T T -measurable partition of 0. 
Define a T T - measurable function w by 

w = u t 1a 1 + c t 1a 2 + b T lA 3 - 
Define a stopping game V* = (Q, A, P, {T t )t>o, (a* t ,b* t ,c* t ) t > ) by: 

a t t <t I b t t <t \ c t t <t 

W t > T I W t > T I W t > T 

That is, the payoff is set to w at and after time r. 

The game T* satisfies the assumptions of Proposition 111! hence it has a 
value in mixed strategies V. Moreover, for every e > both players have 
(5-pure e-optimal strategies, provided 5 > is sufficiently small. 

We now prove that V is the value of the game T as well. Fix e > 0. We 
only show that player 1 has a mixed strategy <j> such that inf^7r(0, v) > 
V — 7e. An analogous argument shows that player 2 has a mixed strategy 
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-0 such that sup^ 7r(/i, V ; ) — V + 7e. Since e is arbitrary, V is indeed the 
value in mixed strategies of T. 

Assume 5 is sufficiently small so that the following conditions hold (by 
the proofs of Lemma El and Proposition 1111 such 5 exists). 

(CI) Player 1 has a <5-pure e-optimal strategy 4>* = [i + r5 in T*. 

(C2) P({fi + 5 <t})> P({fj, < t}) - e/M, where M g]0, +oo[ is a uniform 
bound of the payoff processes. 

(C3) P({\a t -a T \ < e, \b t -b T \ <e Vt G [t,t + <5]}) > 1 - e. 

We now claim that one can choose jx so that \i < r. Indeed, assume that 
P({Ai > r}) > 0. The set {a* > r} is ^--measurable. Define a stopping time 
// = min{/i, r}. We will prove that the <5-pure strategy = + r5 is also 
e-optimal in T*, which establishes the claim. Given a stopping time v define 
a stopping time v' as follows: v' = r over {// > r}, and v' = u otherwise. 
Then 

V - e < 7r* (a* + rtf, i/) = 7r* (// + r<5, i/; > r}) + 7r* (a* + rtf, i/; {/x < r}). 

However, 7r*(/U + rS, v'; {fj, > r}) = Ex<s,p[wl^ >T y] = 7r*(/i' + r£, i/; {/i > 
r}), and since fx = fj/ and u = u' over {// < r}, 7r*(A 1 + r ^ ^'j {A 1 — r }) = 
7r* (a*' + r( 5> ^; {a* — r }- Therefore 

7r* (a 1 ' + r ^ v) = 7r* (a* + r ^ v')>V — e. 

Since v is arbitrary, ii! + r<5 is e-optimal, as desired. 
Define a mixed strategy <f> as follows. 

At + r5 {fj, < t} U A , 

^(r,-) = < t = r} n (Ai U A 2 ) , 

^ /x + rJ {Ai = r}nA 3 . 

Observe that cf) is 5-almost pure. 

The mixed strategies 4> and 4>* differ only over the set {/i = r} n 
(Ai U.A2). Since over this set the payoff in T* is w provided the game 
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terminates after time r, whatever the players play, <j> is an e-optimal mixed 
strategy in T*. 

Let v be an arbitrary pure strategy of player 2. Define a partition 
(B Q ,B X ,B 2 ) of [0,1] xftby 

B = {ii + 5 < t} U {v < r}, 

B\ = {fi < t < n + 5} n {v > r}, and 

B 2 = ({/-* = t or /i = +00}) n {z/ > r}. 

Over i?o the game terminates before time r under {(f), u). In particular, 

lr(<P,v,B ) = 7r*0,z;; J Bo)- (7) 

By (C2) A <g> P(Bi) < e/M, so that 

7 r(0,i/;Sa)>7r.(0 ) i/;B 1 )-2e. (8) 

Over B2 n the game never terminates under ((f), v), so that 

jr(<f>,v,B 2 nAo) =~fr*(^,v,B 2 nA ) = 0. (9) 

Over A\ U A 2 , min{a T , c T } > u;, so that 

7r0, ^;B 2 n(iiUA 2 )) = E A0 p[l B2n(AlUj42) (a r l {r<I/} + c T l {T=Jy} )] 

> E A ®p[w;l{ r < I/ }nB 8 n(AiuA2)] ( 10 ) 
= ir*((f),v,B 2 n (Ai L)4 2 )). 

Finally, since A (g> P ({// + r<5 = z/}) = 0, by Corollary since (ct) t>0 is 
progressively measurable, and since a T > b T = w over A3, 

lr(<t>, V, B 2 l~l ^4 3 ) = E A( g,p[lB2nA3 (a-^+r8^-{n+r5<u} + K^-{n+rS>v} + Cj/l{^ +r< 5 
= Ex®p[lB 2 nA s (a f i+r5l{iJ,+r8<i>} + b v l{n+r8>v})] 

> ^X»p[ i -B 2 nA 3 (a T 'i-{fM+r8<iy} + K^-{^+ r 5>v})] ~ ^ e 

> Ex®p[wlB 2 nAa] -4e 
= 7r *(0,i/;P2nA3). 
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Summing Eqs. (|7jl- (|TT|l . and using the e-optimality of eft* in T* , gives us 
V - e < 7r*(<^,z/) < 7r(</>,^) + 6e, 

as desired. 

4 Extensions 

In the present section we construct specific e-optimal strategies in the spirit 
of Dynkin (1969) or Rosenberg et al. (2001), and we give conditions for the 
existence of the value in pure strategies. We then provide two extensions to 
the basic model. 

4.1 Construction of an ^-optimal strategy 

Let T = (fi, A, P, {Tt)t>o, ((H,bt, ct)t>o) satisfy the conditions of Theorem^ 

Define r, (A , A x , A 2 , A 3 ), w and T* = (Q, A, P, {F t )t>o, (a* t ,b* t ,c* t ) t > ) 
as in the proof of Theorem [3 

For any stopping time a let T* = (Q, A, P, (Ft)t>o, { a ti b*, c t )t>o) be the 
game starting at time a; that is, players are restricted to choose strategies 
that stop with probability 1 at or after time a. 

Lepeltier and Mainguenau (1984, Theorem 13) and Proposition II II show 
that this game has a value in mixed strategies X*. Moreover, the value is 
independent of (cjf) t>0 . 

Using a general result of Dellacherie and Lenglart (1982), Lepeltier and 
Mainguenau (1984, Theorem 7) show the existence of a right-continuous 
process (V t *) t>0 such that V* = X* for every stopping time a. 

For every e > define a stopping time 

M * = inf{i>0:VT<a t * + ^}. 

By definition of r and T* , one has /i* < r. 

Lepeltier and Mainguenau (1984, Theorem 13) and Proposition llll implv 
that fj,* is ^-optimal for Player 1 in any game V = (f2, A, P, (Ftjt^o, i a t > K,dt)t>o), 
where (dt) t>0 is any process satisfying ajf < d t < b\ for any t > 0. 
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Let 5 be such that P{{\a t -a^ \ < ^, Vt G [/4> M* + £]}) > 1 ~ ^- From 
the proof of Proposition ^2 we deduce that fi* + r5 is ^-optimal for player 
1 in r*. 

Now, assume that S is sufficiently small so that 

. P({/x* + 6 < r}) > P(K < r}) - 7 f 7 , and 

• P{{\a t -a T \ < f,|fet-6 T | < f Vi € [r, r + <5]}) > 1 - f . 

Define a mixed strategy </> £ as follows. 

' fj* + tS {h* £ < t} U A), 

e (?v) = < r {/i* = r} n (^i U A 2 ) , 

The proof of Theorem [7] implies that e is e-optimal for player 1 in V. 

Assume that c r > b T a.s. (or, equivalently, that A\ U A 2 = f2). By the 
proof of Proposition 111! it is 0-optimal for Player 1 in T to stop at time 
r, provided the game reaches time r. If in addition one has at < Q < 
6* for every t € [0, r[, by the proof of Proposition 1111 and Lepeltier and 
Mainguenau (1984, Theorem 13) we deduce that the pure stopping time 
inf {t > : V t * < + e} is e-optimal for Player 1 in T. Hence one obtains 
the following. 

Proposition 12 If ct G co{at, bt} for every t € [0, r] then the value exists in 
pure strategies. An e-optimal strategy for Player 1 is inf {t > : V t * < ajf + e}, 
and an e-optimal strategy for Player 2 is inf {t : V* > 6| — e} . 

Corollary 13 Every stopping game such that (at,bt,Ct) t>0 are continuous 
and satisfies cq £ co{ao,fro} admits a value in pure strategies. 

4.2 On final payoff 

Our convention is that the payoff is if no player ever stops. In fact, one 
can add a final payoff as follows. Let x be an A- measurable and integrable 
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function. The expected payoff that corresponds to a pair of pure strategies 
(fi,v) is: 



E p[ a M 1 {M<^} + ^ 1 {M>^} + C M 1 {M=^<+°o} + X 1 {n=v=+oo}]- 

The expected payoff can be written as: 

E P [ X ] + E P [(a„ - Ej" [ X ] ) 1 {/1 <„ } + (&„ - E^ [*]) 1 {m> , } 

+ (c„ - e£" [ X ]) 1 {/1 =„< +oo} ] , 

where E p M [x] is the conditional expectation of x given the cr-algebra T^. 

Define a process dt := Ep' [x] ■ Since the filtration satisfies the "usual 
conditions", (dt) t>0 is a right-continuous martingale (see, e.g., Dellacherie 
and Meyer, 1980, §VI-4). Hence we are reduced to the study of the standard 
stopping game T* = (Q, A, P, {F t )t>o, « A*; c* t ) t > ) with a* t = b t - d t , b\ = 
bt — dt and c* = q — dt- 

4.3 On cumulative payoff 

In our definition, players receive no payoff before the game stops. One can 
add a cumulative payoff as follows. Let (xt) t>0 be a progressively measurable 
process satisfying Ep / + °° \xt\dt < +00, and suppose that the expected 
payoff that corresponds to a pair of pure strategies (/U, u) is given by 

cmin{|U,z/} 



Ep 



r 

J 



Xfdt 



The expected payoff can be written as 
Ep + J x t dtj l^u} + (b v + J x t dtj 1{^> J ,} 

+ (c-pL + J x t dtj l{^= u <+oo} + Ep 1{ m =i/=+oo} x J x t dt 



Thus, the game is equivalent to the stopping game T* = (Q, A, P, {Tt)t>o, (a* j &t j c£)t>o) 
with terminal payoff x = Jo°° x tdt, where a* = at + J * a^sds, b^ = b t + J Q * x s ds, 
and = q + J Q * x s c/s. 



19 



References 

[1] M. Alario-Nazaret, J. P. Lepeltier and B. Marchal (1982) Dynkin games, 
Stochastic Differential Systems (Bad Honnef), 23-32, Lecture notes in 
Control and Information Sciences, 43, Springer Verlag. 

[2] R.J. Aumann (1964) Mixed and behavior strategies in infinite exten- 
sive games, in Advances in Game Theory, M. Dresner, L.S. Shapley 
and A.W. Tucker (eds.), Annals of Mathematical Studies 52, Princeton 
University Press. 

[3] A. Bensoussan (1984), On the theory of option pricing. Acta Applicandae 
Mathematicae, 2, 139-158. 

[4] J.M. Bismut (1977) Sur un probleme de Dynkin. Z. Warsch. V. Geb., 
39,31-53. 

[5] J. Cvitanic and I. Karatzas. Backward stochastic differential equations 
with reflection and Dynkin games. Ann. Probab., 24, 2024-2056, 1996. 

[6] C. Dellacherie and E. Lenglart (1982) Sur des problemes de 
regularisation, de recollement et d'interpolation en theorie generale des 
processus. Seminaire de Probabilites XVI, Lecture Notes. Springer Ver- 
lag. 

[7] C. Dellacherie and P.-A. Meyer (1975) Probabilites et potentiel, 
Chapitres I a IV, Hermann. English translation: Probabilities and po- 
tential. North-Holland Mathematics Studies, 29. North-Holland Pub- 
lishing Co., Amsterdam-New York; North-Holland Publishing Co., 
Amsterdam-New York, 1978. 

[8] C. Dellacherie and P.-A. Meyer (1980) Probabilites et potentiel, 
Chapitres V a VIII, Theorie des Martingales, Hermann. English trans- 
lation: Probabilities and potential. B. Theory of martingales. North- 
Holland Mathematics Studies, 72. North-Holland Publishing Co., Am- 
sterdam, 1982. 



20 



[9] E.B. Dynkin (1969) Game variant of a problem on optimal stopping, 
Soviet Math. DokL, 10, 270-274. 

[10] P. Ghemawat and B. Nalebuff (1985) Exit, RAND J. Econ., 16, 184-194 

[11] I. Karatzas (1988) On the princing of American options, Appli. Math. 
Optimization, 17, 37-60. 

[12] R. Laraki (2000) Jeux repetes a information incomplete: approche vari- 
ationnelle, These de Doctorat de I'Universite Paris 6, France. 

[13] J. P. Lepeltier and M.A. Mainguenau (1984) Le jeu de Dynkin en theorie 
generale sans Phypothese de Mokobodsky. Stochastics, 13, 25-44. 

[14] J. Ma and J. Cvitanic (2001) Reflected forward-backward SDE's and 
obstacle problems with boundary conditions. Journal of Applied Math- 
ematics and Stocastic Analysis, 14, 113-138. 

[15] Neveu J. (1975) Discrete-Parameter Martingales, North-Holland, Am- 
sterdam 

[16] D. Rosenberg, E. Solan, and N. Vieille (2001) Stopping games with 
randomized strategies. Probab. Th. Rel. Fields., 119, 433-451. 

[17] E. Shmaya and E. Solan (2002) Two-player non-zero-sum stopping 
games in discrete time, Discussion Paper, 1347, The Center for Math- 
ematical Studies in Economics and Management Science, Northwestern 
University. 

[18] M. Sion (1958) On general minmax theorems. Pacific Journal of Math- 
ematics, 8, 171-176. 

[19] N. Touzi and N. Vieille (2002) Continuous-time Dynkin games with 
mixed strategies. SI AM J. Cont. Opt., forthcoming. 



21 



